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ABSTRACT:  With  today’s  reports  of  deteriorating  highways  and  infrastructure  as 
well  as  increased  litigation  arising  from  structural  failures  and  the  construction 
process,  there  is  an  increasing  desire  to  employ  non-destructive  testing  and 
evaluation  (NOTE)  methods  for  analyzing  structural  concrete  members  as  well  as 
other  construction  materials  in  a  noninvasive  manner.  A  major  part  of  NOTE 
techniques  is  defect  characterization,  which  is  a  typical  pattern  classification 
problem.  The  current  state  of  the  art  for  solving  this  problem  is  the  application  of  a 
human  expert’s  knowledge  and  experience  for  interpreting  NOTE  data  Artificial 
neural  networks  (ANNs)  have  shown  a  propensity  for  solving  the  pattern 
classification  problem  in  the  areas  of  speech  and  vision  recognition,  as  well  as 
problems  in  system  modeling  and  simulation.  As  a  result  of  these  successful  ANN 
applications,  this  paper  explores  the  possibility  of  using  ANNs  for  the  NOTE  defect 
characterization  problem.  Part  of  the  solution  of  defect  characterization  entails  the 
capability  to  filter  what  would  otherwise  be  considered  noisy  data.  Therefore,  an 
ANN  architecture  iv  proposed  and  tested  via  computer  simulation  for  the  purpose  of 
discerning  between  cracks  and  other  surface  defects  found  in  photographs  of 
defective  reinforced  concrete  sections.  Also,  a  basic  introduction  to  ANNs  is 
included  along  with  a  recommendation  for  continuing  research. 


\.  INTRODUCTION 

Reinforced  concrete  generally  performs  well  as  long  as  conditions  for  its 
installation  and  use  fall  within  the  parameters  for  which  it  was  designed. 
However,  there  have  been  and  always  will  be  occasions  involving  severe 
construction  conditions,  construction  mistakes,  faulty  design,  unforeseen  disasters 
such  as  fire  and  flood,  and/or  unanticipated  loads  placed  on  structural  concrete. 
As  a  result  of  these  aforementioned  inauspicious  circumstances,  a  reinforced 
concrete  member  will  show  signs  of  distress,  i.e.  cracking,  dusting,  scaling, 
spauling,  etc.  These  signs  of  distress  will  require  either  one  or  some 
combination  of  the  owner,  designer,  and/or  constructor  to  investigate  the 
reinforced  member  to  determine  its  strength,  anticipated  longevity,  and  need  for 
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replacement.  Indisputably,  it  is  ideal  with  respect  to  time  and  money  to 
investigate  the  structure  without  doing  any  damage  to  the  member;  for  this 
reason,  non-destructive  test  and  evaluation  (NOTE)  methods  have  become 
popular  and  necessary  means  for  analyzing  the  integrity  of  structural  concrete. 

Like  many  other  scientific  techniques,  NDTE  heavily  relies  on  some 
expert  to  collect,  graph,  and  interpret  data.  Certainly,  there  will  never  be  an 
engineering  tool  which  will  eliminate  the  need  for  experts  and  good  judgement. 
However,  automation  of  NDTE  methods  would  improve  the  speed  of  analyses 
and  likely  increase  the  frequency  with  which  these  methods  are  used.  At  a 
minimum,  NDTE  automation  would  allow  "non-experts"  who  become  trained  on 
automated  NDTE  systems  to  engage  in  initial  data  collection  and  defect 
classification  part  of  the  problem. 

NDTE  data  collection  and  interpretation  is  generally  a  problem  in 
pattern  classification,  i.e.  a  true  expert  would  almost  instantly  recognize  that  data 
from  any  given  situation  fits  some  particular  problem  and  solution  method  which 
he  has  before  seen.  However,  pattern  classification  lends  itself  poorly  to 
traditional  computing  methods.  Conventional  computer  pattern  classification  has 
involved  feature  extraction  and  clustering  which  more  often  than  not  requires 
the  use  of  extensive  prior  information,  such  as  the  statistical  distribution  of 
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In  the  case  of  NDTE  data  pattern  classification,  the  computerization 
problem  is  compounded  with  the  fact  that  the  cause  for  and  impact  of  defects  on 
materials,  like  many  other  real  world  functions,  is  extremely  complex  to  model, 
requires  the  consideration  of  many  factors  (independent  variables),  and  is  not 
completely  understood. 

Enter  the  artificial  neural  network.  An  artificial  neural  network  (ANN)  is 
either  a  hardware  or  software  system  which  attempts  to  imitate  the  neural 
structure  and  functioning  of  the  biological  brain  (Sejnowski,  Kock,  and 
Churchland,  1988).  The  brain  uses  millions  of  elementary  processors  known  as 
neurons  which  are  interconnected  by  synapses  and  process  sensory  information 
(sight,  sound,  touch,  smell,  and  taste),  thus  allowing  us  to  perceive  and  ultimately 
react  to  our  environment.  Similar  to  its  biological  counterpart,  an  ANN  is  a 
massively  parallel,  interconnected  network  of  simple  processors  which  can 
receive  and  process  many  independent  variables.  The  basic  advantage  of  the 
ANN  over  other  traditional  serial  computing  techniques  is  the  ability  to  take  into 
account  and  process  many  independent  variables  much  faster. 

In  addition,  ANNs  have  shown  promise  for  successfully  performing  a 
variety  of  cognitive  tasks,  including  statistical  pattern  classification.  Practical 
applications  of  ANNs  as  pattern  classifiers  and  the  need  for  real-time  response 
to  real-world  data  have  led  to  advances  in  automated  speech  recognition,  vision 
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recognition,  robotics,  and  other  various  engineering  and  artificial  intelligence 
applications. 

NDTE  defect  classification  is  similar  to  the  aforementioned  real-world 
cognition  problems  for  which  ANNs  have  already  been  shown  to  have  promise, 
i.e.  problems  requiring  the  processing  of  many  independent  variables  and  the 
classification  of  the  result.  By  combining  ANNs  with  NDTE,  a  significant 
improvement  is  expected  in  the  consistency,  accuracy,  and  ease  of  classifying 
NDTE  data,  i.e.,  a  fraction  of  a  second  to  classify  an  x-ray  image  or  surface 
photograph. 


II.  LITERATURE  REVIEW 

Despite  the  initial  skepticism  in  their  applications  and  abilities  (Minsky 
and  Papert,  1969),  ANNs  have  been  shown  by  contemporary  research  as  capable 
of  solving  a  variety  of  engineering  problems.  The  list  of  ANN  applications 
includes: 

•  Classification  of  speech  sounds  (Lippman,  1987), 

•  Recognition  of  incoming  military  targets  (Roth,  1990), 

•  Formation  of  text-to-phoneme  rules  (Sejnowski  and  Rosenberg,  1987), 
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•  Deduction  of  the  secondary  structure  of  a  protein  from  its  amino  acid 
sequence  (Qian  and  Sejnowski,  1988), 

•  Discrimination  between  underwater  sonar  signals  (Gorman  and 
Sejnowski,  1988), 

•  Recognition  of  handvniting  (Weideman,  Manry,  and  Yau,  1989), 

•  Learning  good  moves  for  backgammon  (Tesauro  and  Sejnowski,  1988), 

•  Performance  of  nonlinear  signal  processing  (Lippman  and  Beckman, 
1989;  Tamura  and  Waibel,  1988), 

•  Prediction  of  the  amount  of  energy  needed  to  modify  the  thermal  energy 
stored  in  a  building  mass  (Garret,  et  al,  1991), 

•  Controlling  the  threshing  module  of  a  combine  harvester  (Garret,  et  al, 
1991), 

•  Design  of  pump  locations  and  rates  of  operation  (Garret,  et  al,  1991), 

•  Recognition  of  machining  features  from  a  CAD  drawing  (Garret,  et  al, 
1991), 

With  the  successes  of  the  back-propagation  neural  network  classifier 
(Rumelhart,  McClleland,  et  al,  1986)  and  other  various  ANN  forms,  the  field  of 
construction  engineering  and  management  has  been  also  been  targeted  as  an 
area  rich  with  potential  ANN  applications  (Mohan,  1990).  Some  proposed 
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applications  in  construction  engineering  and  management  (Moselhi,  O.,  Hegazy, 
T.,  and  Fazio,  P.,  1991)  include: 

•  Predicting  the  bearing  capacity,  foundation  suitability,  and  feasible 
dewatering  methods  based  on  geotech-'ical  data, 

•  Estimating  productivity  of  a  crew,  project  performance,  and  cost  overruns 
from  project  environment  data, 

•  Determining  project  markup  from  various  project  data, 

•  Optimizing  construction  schedule  and  resources  based  on  historical  and 
current  project  data, 

•  Forecasting  material  costs  as  a  function  of  various  construction  market 
place  data. 

Another  application  involved  the  use  of  ANNs  for  land-cover 
classification  of  Thematic  Mapper  imagery  (Ritter  and  Hepner,  1990). 

And  yet  another  proposed  application  of  the  ANN  is  that  of  sequencing 
construction  tasks  (Flood,  1989  and  1990). 

A  particularly  interesting  concept  is  one  that  explores  the  combination  of 
the  pattern  classification  and  modeling  capabilities  of  ANNs  with  the  heuristic 
rules  of  current  expert  systems;  this  combination  of  Artificial  Intelligence  and 
ANNs  has  interested  many  researchers  (Gallant,  1988;  Castelaz,  Angus,  and 
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Mahoney,  1987,;  Derthick,  1987;  Fahlman  and  Hinton,  1986).  The  marriage  of 
the  two  would  provide  a  powerful  computing  tool  which  could  not  only  be  used 
for  scheduling  construction  tasks,  but  also  could  assist  in  identifying,  classifying, 
and  determining  the  probable  causation  and  potential  solutions  for  defects  in 
structural  concrete. 

NDTE  methods  require  an  expert  to  interpret  highly  distributed,  noisy 
information  for  the  purpose  of  identifying  the  nature,  location,  and  causes  of 
defects  in  materials.  One  example  of  this  type  of  application  was  the  use  of 
ANNs  for  classification  of  eddy  current  signals  resulting  from  electromagnetic 
fields  generated  to  inspect  conducting  materials,  such  as  stainless  steel  (Udpa 
and  Udpa,  1991).  The  Udpas  were  able  to  successfully  use  a  backpropagation 
trained  two-layer  feedforward  ANN  to  classify  the  eddy  current  signals  in  terms 
of  the  shape  and  size  of  the  defects  in  their  test  objects.  In  fact,  they  obtained 
better  results  with  the  ANN  than  with  more  traditional  techniques  for 
classification  of  such  signals. 

ANNs  have  also  been  applied  to  the  classification  of  signals  from  NDTE 
ultrasonic  and  sonic  methods  (Garret,  et  al,  1991).  In  this  instance,  a 
backpropagation  two-layer  feedforward  ANN  was  successfully  used  to  interpret 
data  received  from  a  pulse-echo  hammer  test  to  detect  the  presence  of  a  flaw  in 
a  masonry  wall. 
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Although  some  applications  to  NOTE  techniques  have  been  proposed 
there  are  many  other  NOTE  methods  which  require  study.  In  the  case  of 
structural  concrete,  NOTE  can  be  used  to  determine  structural  concrete’s  in- 
place  strength,  uniformity  of  strength,  cracks,  delaminations,  thickness,  rebar 
location,  depth  of  cover,  and  other  discontinuities  or  conditions.  Figure  1 
provides  an  overview  of  NDTE  methods  for  investigating  the  aforementioned  as 
well  as  other  conditions  ("Specialized  Concrete  Evaluation  and  Testing.",  1984). 
A  summary  explanation  of  each  of  the  different  NDTE  methods  used  in 
examining  concrete  is  shown  in  Appendix  I. 

The  first  step  in  any  NDTE  investigation  is  a  visual  survey  which  includes 
observations  of  the  surface  conditions,  the  extent  of  cracking,  obvious  loading 
problems,  settlement,  poor  drainage,  chemical  corrosion,  etc.  In  structural 
concrete  it  is  typically  the  presence  of  an  observable  physical  defect  which 
initiates  any  subsequent  investigation.  More  times  than  not,  the  physical  defect 
of  concern  is  cracks.  As  can  be  seen  by  the  following  quote,  some  believe  that 
cracks  are  extremely  significant  in  the  analysis  of  structural  concrete  members: 

"Cracks  in  structural  concrete  are  like  hieroglyphics-they  are  pictures  that 
can  communicate."  (Gustaferro  and  Scott,  1990) 
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Figure  1:  CONCRETE  NOTE  METHODS  ("Specialized  Concrete 


Evaluation  and  Testing",  1984) 

The  first  observations  an  NDTE  expert  makes  regarding  cracks  in  concrete  is  the 
orientation  of  the  cracks  with  respect  to  the  orientation  of  stresses  on  the 
member.  These  observations  will  allow  the  expert  to  use  his  experience  to 
determine  why  the  cracking  is  occurring.  From  this  assertion,  it  is  reasonable  to 
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conclude  that  any  automated  system  used  to  analyze  cracks  in  reinforced 
concrete  must  also  be  able  to  determine  what  type  of  crack  is  being  viewed.  If 
this  is  so,  the  design  of  the  automated  NDTE  system  must  include  image 
processors  which  are  able  to  distinguish  a  crack  from  a  hole,  joint,  or  other 
surface  defect.  Thus,  one  of  the  first  analyses  of  the  automated  system  would  be 
to  filter  surface  defects  from  the  image  of  the  cracked  member.  Therefore,  we 
will  investigate  the  application  of  ANNs  for  filtering  and  enhancing  surface 
photographs  of  cracking  concrete. 

III.  AIMS  AND  OBJECTIVES  OF  THE  RESEARCH 

The  primary  objective  of  this  research  was  to  investigate  the  use  of  ANNs 
for  the  purpose  of  acting  as  a  filter/enhancer  for  surface  photographs  of 
concrete  structures.  The  filter /enhancer  ANN  would  discriminate  between 
cracks  and  other  non-critical  surface  features  contained  in  the  photograph. 

In  order  to  achieve  the  primary  objective  the  following  interim  objectives 
were  established: 

a)  Review  basic  ANN  concepts,  and  consider  the  applicability  of 
ANNs  to  this  specific  problem,  including  state-of-the-art 
applications  and  research  involving  ANNs; 


b)  Analyze  the  problem  in  terms  of 
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•  Investigating  the  types  of  neural  architecture  and  training 
procedures  that  have  potential  application  to  the  problem, 

•  Collecting  and/or  developing  sets  of  data  for  use  in  training 
and  testing  the  ANN; 

c)  Train  the  ANN  designed  using  the  data  developed  from  the 
previous  goal; 

d)  Implement  and  evaluate  the  trained  network  on  some  surface 
photographs  and  evaluate  the  results. 

IV.  RESEARCH  METHODOLOGY 

Figure  2  shows  the  main  stages  comprising  the  project. 

Phase  A  involved  a  literature  search  to  provide: 

•  Insight  into  basic  ANN  architectures  and  training  procedures,  and 

•  An  overview  of  research  reflecting  current  state-of-the-art 
applications  of  ANNs  for  data  modeling  and  pattern  classification, 
and  any  specific  research  related  to  the  use  of  ANNs  for  the 
classification  of  defects  from  NOTE  data. 

Phase  B  was  concerned  with  developing  data  for  use  in  training  the  ANN 
and  design  of  the  ANN  to  be  used.  The  ANN  design  will  be  based  upon  the 
information  gathered  in  Phase  A.  The  data  to  be  collected  for  training  will  be 
extracted  from  surface  photographs  of  cracking  concrete.  The  data  was 
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Figure  2:  SCHEDULE  OF  WORK 

imported  into  an  IBM  compatible  computer  with  the  use  of  a  scanner.  Then  by 
use  of  software  developed  for  the  specific  purpose,  the  training  data  was  then 
organized  and  labeled. 

Phase  C  consisted  of  training  and  completing  the  design  of  the  ANN  to 
be  used  as  a  filter  for  the  scanned  in  crack  images.  Since  ANNs  are  relatively 
new  technology,  little  if  any  hardware  currently  exists.  Therefore,  the 
development  and  experimentation  will  be  undertaken  using  software  emulation 


raper  >  Apnl  1 


Neural  Networks  &  Non-Destructive  Test/Evaluation  Methods 

of  the  ANNs  on  an  IBM  compatible  computer.  Training  was  completed  using 
software  developed  by  Ian  Flood,  the  student’s  faculty  advisor  at  the  University 
of  Maryland,  College  Park,  Department  of  Civil  Engineering. 

Phase  D  entailed  implementing  and  evaluating  the  ANN  proposed  and 
trained  in  previous  phases.  Evaluation  was  based  on  the  subjective  visual 
comparison  of  the  filtered/enhanced  image  to  that  of  the  original  image.  In  this 
case,  the  student  developed  software  for  the  implementation  of  the  trained 
network. 

Phase  E  was  the  culmination  of  the  findings  of  this  work  into  a  final 

report. 

V.  ARTIFICIAL  NEURAL  NETWORK  BASICS 

In  this  section,  a  brief  introduction  is  given  to  ANNs  as  relevant  to  this 
paper.  A  more  detailed  introduction  to  ANNs  including  the  necessary  elements 
of  an  ANN’S  architecture  and  training  procedures  can  be  found  in  works  by 
other  researchers  (Rumelhart  and  McClelland,  1986;  Lippman,  1989).  The 
determination  of  an  ANN  architecture  and  training  is  highly  problem  dependent 
(Lippman,  1989;  Moselhi,  Hegazy,  Fazio,  1990).  The  performance  of  ANNs  can 
be  significantly  affected  by  the  number  of  layers  and  the  number  of  neurons  in 
each  layer  (Rumelhart  and  McClelland,  1986;  Huang  and  Lippmann,  1987, 
Gorman  and  Sejnowski,  1988).  The  network  architecture  and  transfer  functions 
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must  be  able  to  distinguish  between  classes  of  data  presented  to  the  network,  be 
insensitive  to  slight  variations  in  the  input,  and  have  a  limited  number  of 
neurons  to  permit  efficient  computation  and  limit  training  data  required. 
Excellent  discussions  regarding  the  types  of  ANN  classifiers,  their  memory 
requirements,  and  performance  characteristics  have  been  written  (Rumelhart, 
McClleland,  et  al,  1986;  Lippman,  1989;  Bailey  and  Thompson,  1990). 

Architecture.  Figure  3  is  a  simple  three-layer  network  consisting  of  an 
input  layer,  a  hidden  layer,  and  an  output  layer.  The  ANN  is  made  up  of 
neurons  (the  nodes),  and  connections  (the  lines  connecting  the  nodes).  The 
architectures  (physical  configurations)  of  neural  networks  are  described  by  the 
number  of  layers  of  neurons  in  the  network,  the  number  of  neurons  in  each 
layer,  and  their  connections  with  one  another.  There  are  two  general  classes  of 
ANN  architectures: 

•  feedforward,  or  nonrecurrent,  and 

•  recurrent. 

The  ANN  shown  in  Figure  3  is  a  feed-forward  network  which  means  the  flow  of 
information  is  in  only  one  direction.  Recurrent  networks  differ  from  feed¬ 
forward  networks  in  that  they  contain  feedback  connections  between  layers  or 
between  neurons  in  the  same  layer. 

Every  neuron  performs  both  a  summation  function  (E)  and  a  transfer 
function  (/).  Each  neuron  receives  a  set  of  inputs  (real  or  discrete  data)  from 
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IMdsn  output 

UQMr  Uvtr 


i  k :  Input  neuron  hidden  neuron  :  output  neuron 

/ :  transfer  function,  i.e.  sigmoid,  step  function,  1 ,  etc. 
s:  summation  of  aii  inputs  to  pioduoe  the  neuron 
activation  vaiue 

w,  V  :  connection  weights  between  Input  &  hidden  layer 


Figure  3:  THREE-LAYER  FEEDFORWARD  NEURAL  NETWORK 
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the  preceding  layer  of  neurons,  with  the  exception  of  the  input  layer  which 
receives  inputs  from  the  network’s  interface  with  its  environment.  A  neuron 
adds  its  incoming  inputs  together  to  produce  a  sum  known  as  that  neuron’s 
activation  value,  a.  The  activation  value,  a,  is  then  operated  upon  by  the 
neuron’s  transfer  function,  /,  to  produce  the  neuron’s  output.  The  transfer 
function  can  be  just  about  any  function  including  the  identity  function.  Hidden 
layer  neurons  commonly  have  a  transfer  function  of  one  of  the  forms  shown  in 
Figure  4.  However,  the  transfer  function  can  be  just  about  any  mathematical 
form  which  provides  an  output  between  0  and  1  and  satisfies  both  the  needs  of 
the  network  and  the  problem  being  solved.  Sometimes,  the  transfer  function 
passes  information  out  of  the  neuron  only  if  a  is  greater  than  some  value  known 
as  the  threshold,  t;  otherwise  the  output  of  the  neuron  is  set  equal  to  zero.  If 
the  transfer  function  is  a  discrete  threshold  function,  the  output  will  be  1  if  a  ^  t 
and  0  if  a  <  t.  If  the  transfer  function  is  continuous,  the  output  of  the  neuron  is 
a  real  number  between  0  and  1.  Transfer  functions  can  also  contain  other 
constants  such  as  bias,  b.  Biases  and  the  other  constants  position  the  resulting 
transfer  function  relative  to  the  activation  value  axis. 

The  output  of  each  neuron  is  operated  upon  by  the  weights,  w  or  v,  on 
the  connections  to  the  next  layer  of  neurons.  The  connection  mathematics 
usually  takes  the  form  of  a  simple  multiplication  of  the  neuron’s  signal  by  the 
connection  weight,  however  other  forms  are  possible.  This  operated  upon  signal 
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Figure  4;  COMMON  NEURON  TRANSFER  FUNCTIONS 
becomes  the  input  to  the  next  layer  of  neurons,  or  the  output  from  the  ANN  to 
the  environment. 


Training.  Training  or  learning  is  the  process  of  adapting  the  connection 
weights,  thresholds,  and  other  variables  of  the  ANN  in  response  to  training  data 
being  presented  to  the  network.  The  training  method  (or  learning  rule)  is  the 
mathematical  relationship  that  generates  an  ANN’s  desired  output  for  a 
particular  set  of  inputs  while  setting  the  coefficients  (b,  t,  w,  v,  etc.)  in  the 
neuron’s  local  memory. 

Training  can  take  one  of  three  basic  forms  as  shown  in  Figure  5 
(Lippman,  1989).  The  three  types  of  training  methods  are  "supervised", 
"unsupervised",  and  a  combination  of  the  supervised  and  unsupervised. 

Supervised  training  implies  that  the  ANN  is  presented  input  data  (called 
patterns)  along  with  the  desired  output  (called  targets),  and  simply  organizes  its 
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Figure  5:  NEURAL  NETWORK  TRAINING  METHODS 

internal  connection  and  transfer  function  parameters  in  order  to  make  the  actual 
ANN  outputs  meet  the  expected  targets.  In  backpropagation  training  for 
example,  the  network  cycles  patterns  of  inputs  attempting  to  achieve  connertion 
weights  and  neuron  responses  that  modify  the  pattern  of  inputs  to  those  of  the 
desired  targets.  At  the  end  of  each  cycle,  the  difference  in  the  output  signal  and 
the  desired  target  acts  as  feedback  to  the  network  to  modify  the  connection 
weights  and  transfer  function  thresholds  for  the  next  cycle. 

Unsupervised  learning  allows  the  network  to  develop  what  are  referred  to 
as  internal  clusters  from  the  patterns  it  is  presented  (no  targets  are  presented), 
i.e.,  the  network  simply  places  its  results  into  groupings  of  outputs. 
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The  combination  method  of  training  allows  the  ANN  to  first  organize  the 
internal  clusters  as  with  the  unsupervised  training  technique,  to  be  followed  by 
labeling  the  clusters  with  targets  and  sequentially  retraining  the  network.  An 
advantage  of  the  combined  training  method  is  that  it  can  simplify  data  collection 
and  reduce  expensive  and  time  consuming  data  labeling. 

VI.  APPLICATION  DEVELOPMENT  OF  THE  ANN  FOR  VISUAL  IMAGE 
ENHANCER  AND  FILTER  PROBLEM 
The  ANN  application  development  procedure  consisted  of  three  phases  as 
shown  in  Figure  6:  design,  training  (learning),  and  implementation  and 
observation. 


Figure  6:  MAJOR  PHASES  OF  ANN  APPLICATION  DEVELOPMENT 
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Design  Phase.  In  the  design  phase,  we  first  needed  to  analyze  the 
attributes  and  parameters  of  the  problem. 

Humans  classify  imagery  by  using  both  spectral  and  spatial  associations 
ingrained  in  biological  neural  networks  which  coimects  their  eyes  to  the  area  of 
their  brain  controlling  vision.  However  for  this  problem,  consideration  of  spatial 
associations  was  sufficient  since  our  computerized  image  was  a  two  dimensional 
image  having  no  spectral  information  and  consisting  of  an  image  of  pixels  which 
were  either  "on"  or  "off*. 

The  problem  was  then  reduced  to  distinguishing  between  the  two- 
dimensional  image  of  a  crack  and  another  type  of  surface  defect.  As  far  as  our 
computerized  image  was  concerned,  the  difference  between  a  aack  and  a 
surface  defect  was  that  a  crack  will  form  a  continuous  line  of  pixels  that  are  "on" 
while  a  surface  defect  will  be  a  few  "on"  pixels  surrounded  by  "off”  pixels. 

By  the  use  of  an  image  sampling  device  consisting  of  a  pixel  window  (an 
array  of  pixels,  i.e.  3  x  3,  5  x  5,  7  x  7,  9  x  9,  etc.)  which  would  methodically  scan 
the  image,  the  network  theoretically  would  be  able  to  assimilate  data  of  spatially 
adjacent  pixels  in  both  the  training  and  implementation  phases  of  this 
application.  In  effect  we  considered  each  element  of  the  pixel  window  to  be  an 
input  to  the  network  with  the  resulting  output  to  be  a  logical  response,  i.e.  "true" 
if  the  pixel  window  represents  a  segment  of  a  crack  or  "false"  otherwise. 
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For  this  visual  filter/enhancer  problem,  the  basic  ANN  paradigm  chosen 
was  that  of  a  back-propagation  trained  feed-forward  network  using  neuronal 
discrete  threshold  activation  functions.  The  criteria  for  the  network  chosen  were 
the  following: 

•  High  network  accuracy 

•  High  interpolative  performance 

•  Since  boolean  input  and  output  are  desired,  the  transfer  function  should 
be  one  that  provides  either  a  0  or  a  1  depending  on  the  comparison  of 
the  neuron’s  activation  value  to  that  of  some  threshold. 

•  No  incremental  learning  or  real  time  performance  desired 

•  Training  time  was  not  an  issue  since  relatively  few  examples  were 
expected  to  be  used. 

•  Relatively  low  memory  requirements  since  the  amount  of  data  generated 
by  graphic  images  is  considerable  and  could  easily  overburden  or  crash 
even  today’s  powerful  desktops  computers. 

Hidden  layers  of  neurons  were  considered  necessary  because  of  the  original 
skepticism  from  experiments  with  the  neural  network  form  known  as  the 
perceptron  (Minsky  and  Fapert,  1969).  Although  others  researching  the  ANN 
application  for  NOTE  data  classification  have  used  networks  with  two-hidden 
layers  (Udpa  and  Udpa,  1991;  Garret,  et  al,  1991),  none  have  given  any  specific 
reasons  for  their  choice  of  architecture.  Some  constructive  proofs  have 
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demonstrated  that  two  hidden  layers  are  sufficient  to  form  arbitrary  decision 
regions  using  multilayer  ANNs  with  discrete  threshold  functions,  while  others 
have  more  recently  shown  that  multi-layer  ANNs  with  only  one  hidden  layer 
(and  no  specific  number  of  hidden  neurons)  could  form  complex  disjoint  and 
convex  decision  regions  (Lippman,  1991).  Since  our  particular  problem  only 
deals  with  a  relatively  simple  decision  region,  having  a  value  of  0  (false)  or  1 
(true),  only  one  layer  of  hidden  neurons  was  considered  adequate.  Additionally, 
by  having  only  one  hidden  layer  of  neurons,  the  training  method  of 
backpropagation  would  be  able  to  be  used  to  determine  the  correct  number  of 
neurons  to  reduce  the  error  between  actual  and  target  outputs  to  zero.  The 
number  of  hidden  neurons  was  found  by  setting  the  parameters  for  the  first 
neuron  and  cycling  through  the  training  patterns  and  targets  until  a  best  fit  could 
be  found.  Then  a  second  neuron  was  added  to  fit  the  errors  remaining  from  the 
first  cycle,  and  so  on  until  the  error  is  reduced  to  zero  or  some  acceptable  value. 

The  method  of  scanning  the  image  with  the  pixel  window  also  became  a 
factor  in  the  application  of  the  ANN.  The  scanning  technique  had  to  operate  in 
such  a  way  that  the  final  enhanced/filtered  image  would  be  the  same  size  as  the 
original  image,  and  at  the  same  time  avoid  the  loss  of  information.  Based  on 
the  way  the  retina  receives  visual  information,  we  determined  each  pixel  window 
sample  should  overlap  its  adjacent  pixel  window  sample.  Therefore,  we  scanned 
the  original  image  by  starting  our  pixel  window  in  the  first  row  leftmost  element 
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of  the  image  and  then  moved  the  pixel  window  one  pixel  (element)  to  the  right 
until  the  end  of  the  image  row  was  reached;  at  that  point  the  pixel  window  was 
moved  down  to  the  next  row  and  the  process  repeated  until  the  last  row 
rightmost  element  was  reached. 

Our  next  effort  in  the  design  phase  of  the  problem  of  filtering  voids  from 
our  image  involved  the  development  of  training  patterns  and  their  targets. 

We  decided  upon  using  3x3  and  9x9  pixel  window  samplers  for  the 
experiment.  The  3x3  sampling  window  represents  the  smallest  window  which 
would  provide  any  spatially  associative  information.  The  9x9  sampling  window 
represents  a  sizeable  increase  over  the  3  x  3  in  respect  to  the  possible  number  of 
combinations  of  pixels  which  could  represent  a  crack  configuration.  A  square 
sampling  window  having  an  odd  number  of  elements  on  each  side  was 
considered  necessary  because  we  defined  a  crack  image  as  a  line  of  "on"  pixels 
passing  through  the  centroid  of  the  sampling  window. 

In  the  case  of  the  3  x  3  pixel  sampling  window,  a  vector  with  9  elements, 
was  created.  Therefore  the  number  of  permutations  of  "on"  and  "off’  pbcels  was 
2’ =5 12.  These  512  combinations  were  generated  using  a  Pascal  program 
PATTERNS3  as  shown  in  Appendix  II.  The  philosophy  on  assigning  the  target 
values  was  to  label  the  target  "true"  for  any  combination  of  the  sampling  window 
which  had  the  center  pixel  of  the  sampling  window  "true"  and  had  at  least  two 
other  pixels  of  the  sampling  window  "on"  but  not  adjacent  to  each  other. 
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TRUE  3X3  SAMPUNG  WINDOWS 


FALSE  3X3  SAMPUNG  WINDOWS 


Figure  7:  SAMPLE  TRAINING  PATTERNS  FOR  THE  3X3 
SAMPUNG  WINDOW 

Otherwise,  the  target  was  set  to  "false".  A  few  examples  of  the  true  and  false 
sampling  windows  are  shown  in  Figure  7. 

In  the  case  of  the  9  x  9  sampling  window,  a  vector  with  81  elements,  was 
created.  Therefore  the  number  of  permutations  of  "on"  and  "off  pixels  is 
2®* =2.4179  X  10^.  Although  this  is  a  finite  number  of  combinations,  only  fewer 
than  800  were  to  be  used  because  of  computer  memory  and  speed  limitations, 
and  the  ability  of  the  ANNs  to  generalize.  We  used  about  600  patterns.  The 
600  input  patterns  and  their  respective  target  values  were  generated  using  the 
Pascal  Program  PATTERNS  (APPENDIX  III).  In  essence,  PATTERNS 
randomly  selects  training  patterns  from  a  scanned  in  photograph  of  cracking 
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concrete  and  generates  a  visual  image  of  the  pattern  on  the  display.  Then  the 
user  enters  the  value  of  the  target  based  on  his  subjective  determination  that  the 
pattern  shown  represents  a  crack  segment.  A  few  examples  of  true  and  false 
sampling  windows  are  shown  in  Figure  8. 

Training  (Learning)  Phase.  Having  the  patterns  and  the  target  values 
established,  the  Pascal  Program  BINARYHAM  (developed  by  I.  Flood)  was 
used  to  train  the  network  and  determine  the  number  of  neurons  in  the  one 
hidden  layer.  BINARYHAM  uses  backpropagation  as  the  training  method  and 
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FALSE  9X9  SAMPLING  WINDOWS 


Figure  8:  EXAMPLE  TRAINING  PATTERNS  FOR  THE  9X9 
SAMPLING  WINDOW 


Neund  Networks  A  Non-Destructive  Test/Evaktation  Methods 


determines  the  number  of  neurons  required  to  make  the  error  between  actual 
and  desired  outputs  equal  to  zero.  The  results  of  the  program  DINAR YHAM 
are  a  set  of  templates  (one  for  each  neuron  in  the  network  of  the  same  length  as 
the  vector  developed  by  the  original  sampling  window)  and  a  set  of  threshold 
values,  one  value  for  each  neuron  in  the  network.  The  results  of  the  program 
DINAR YHAM  for  the  3  x  3  sampling  window  are  shown  in  APPENDIX  IV  and 
those  for  the  9  x  9  sampling  window  are  shown  in  APPENDIX  V.  The  neuron 
template  elements  are  boolean  values  (0= false,  l=true).  The  thresholds  are 
integer  values  which  represent  the  required  activation  value  of  the  incoming 
inputs  to  a  neuron  in  order  to  make  the  network  "fire".  The  basis  for  the  neuron 
operation  is  that  an  incoming  pattern  fi-om  the  image  being  filtered  would  be 
compared  to  a  template  pattern  and  the  differences  summed;  if  he  sum  of  the 
differences  exceeds  the  threshold,  then  the  neuron  would  fire  thereby  producing 
an  output  of  1  (true),  otherwise  the  output  would  be  zero.  A  neuron  output  of  1 
(true)  indicates  the  incoming  pattern  represents  a  segment  of  a  crack.  In 
summary,  the  512  training  patterns  for  the  3  x  3  sampling  window  resulted  in  52 
hidden  neurons,  and  the  600  training  patterns  for  the  9  x  9  sampling  window 
resulted  in  38  neurons.  Since  the  ANN  has  the  ability  to  generalize,  this 
disparity  between  the  number  of  training  patterns  and  the  number  of  hidden 
neurons  was  in  line  with  our  expectations.  The  training  time  for  both  sets  of 
input  patterns  was  seconds  using  an  IDM  compatible  386-33MHz. 


Neural  Networks  &  Non-Destructive  Test/Evaluation  Methods 


Implementation  and  Evaluation  Phase.  In  the  final  phase  of  ANN 
application  development,  the  templates  and  the  thresholds  developed  by  the 
Program  BINARYHAM  were  recalled  to  form  the  ANN  to  be  used.  The 
program  FILTER  was  used  to  scan  the  incoming  image  with  the  sampling 
window  and  to  output  a  filtered/enhanced  image.  The  measure  of  effectiveness 
of  the  filter/enhancer  was  a  visual  comparison  between  the  originally  scanned 
image  and  the  ANN  generated  image. 

Examples  of  the  network  output  using  the  3  x  3  network  filter  are  shown 
in  Figure  9,  and  those  using  the  9  x  9  network  filter  are  shown  in  Figure  10. 

In  the  case  of  the  3  x  3  network  filter,  we  were  able  observe  some  meager 
filtering  capabilities.  Improvement  was  gained  when  the  image  was  iteratively 
ran  through  the  program  FILTER  several  times.  Another  observation  was  that 
noticeable  information  was  lost  at  the  edge  of  the  image  and  at  the  ends  of 
crack  segments. 

In  the  case  of  the  9  x  9  network  filter,  the  filtering/enhancing  capabilities 
were  much  greater.  The  9x9  filter  was  able  to  eliminate  large  quantities  of 
defects  from  the  incoming  image,  however,  it  also  deleted  significant  amounts  of 
crack  information,  especially  at  points  where  cracks  intersected  one  another. 
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Figure  9:  ORIGINAL  VS.  ANN  HLYERED/ENHANCED  IMAGES 


FOR  THE  3X3  SAMPUNG  WINDOW 
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I  ANN  IMAGE  #2  ORIGINAL  //2 

I 

Figure  10:  ORIGINAL  VS.  ANN  HLTERED/ENHANDED  IMAGE 
FOR  9X9  SAMPLING  WINDOW 
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VIL  CONCLUSIONS  &  RECOMMENDATIONS 

Conclusions  from  examples  shown.  All  in  all,  both  ANN  filter/enhancers 
demonstrated  the  ability  to  successfully  eliminate  unwanted  information  from  the 
original  photographic  images.  In  the  case  of  the  3  x  3  filter/enhancer,  the  ANN 
demonstrated  its  ability  to  filter  small  pieces  of  noise  from  the  image.  However, 
the  3  X  3  ANN  filter  was  limited  in  the  size  of  the  surface  defect  that  it  would 
effectively  filter  from  the  incoming  image.  Additionally,  because  of  the  way  in 
which  the  training  patterns  were  labeled,  the  3  x  3  filter/enhancer  slowly  ate 
away  at  the  tips  of  cracks  as  well  as  other  surface  defects. 

The  9x9  ANN  filter/enhancer  demonstrated  greater  abilities  to  extract 
large  amounts  of  defect  information  from  the  image,  but  at  the  expense  of  losing 
pieces  of  the  cracks. 

In  both  cases,  the  deficiencies  with  the  ANN  filter /enhancer  operation 
were  directly  traceable  to  the  training  patterns  and  the  image  scanning 
methodology  specifically  used  for  this  experiment. 

Yet,  even  with  considering  the  deficiencies  of  the  two  ANN 
filter/enhancers  used,  this  experiment  validates  the  ability  of  this  ANN  approach 
for  improving  concrete  crack  images  for  the  ultimate  purpose  of  classifying  the 
cracks  observed. 
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Recommendations  for  fiitiire  work  for  this  aDDiication.  A  more  thorough 
investigation  is  currently  being  undertaken  to  find  a  combination  of  different 
filters  and  scanning  techniques  which  will  be  able  to  overcome  the  problems  left 
remaining  with  this  experiment. 

One  example,  would  be  to  start  with  a  9  x  9  filter  to  eliminate  large 
surface  defects  shown  in  the  image,  then  follow  with  another  filter  which  would 
subsequently  complete  the  missing  crack  information.  Then  apply  a  3  x  3  filter 
to  clean-up  the  image. 

Another  proposed  solution  is  to  use  a  scanning  technique  involving  the 
use  of  a  large  sampling  window  where  the  network  weights  information  at  the 
center  of  the  window  more  heavily  than  at  the  edge. 

By  experimenting  with  different  sampling  window  sizes,  rules  for 
establishing  the  training  patterns,  and  various  scanning  techniques,  this 
researcher  is  confident  that  an  acceptable  filter  for  enhancing  the  photographic 
images  of  concrete  cracks  can  be  found. 

Recommendations  for  future  applications  of  ANNs  to  NOTE  data 
modeling  and  classification  problems. 

In  the  long  run,  we  want  to  be  able  to  combine  the  photograph 
filter/enhancer  ANN  with  another  ANN  classifier  which  would  then  be  used  to 
classify  the  type  of  crack  being  studied. 
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A  follow  on  project  could  be  the  study  of  ANN  applications  for  other 
NOTE  techniques  (say  the  classification  or  modeling  of  acoustic  signature 
recognition  or  radiography).  On  a  grander  scale,  another  possibility  is  to 
combine  the  crack  classifier  ANN  with  one  of  the  other  NOTE  methods  such  as 
acoustic  signature  recognition  to  create  and  analyze  a  3-D  image  of  the  cracked 
structural  member. 

The  pinnacle  of  research  along  these  lines  would  be  the  development  of 
hardware  neural  networks  which  could  be  programmed  and  placed  in  the  field 
for  a  technician  to  use  in  quality  control  or  investigation  of  structural  concrete. 
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APPENDIX  I. 


SPECIFIC  TESTS  USED  TO  EVALUATE 
CONCRETE(Extracted  from  "Specialized  Concrete 
Evaluation  and  Testing",  1984) 


Hew 


«f  the  tests  hricllf  I 
lb  (ASTM)  asMi  the 


wwthe 

(ACl). 


lathe 


lacMetvtaitf 


«ii  iMv  MmU  ital  CM  te 


i  tiM  «r  flNr  eflia  l»  MmI  taMhI  crackt,  f«Uh  «r 


miiinbily  ei  im  plati  tamtnks  atrmffk  md 
of  poor  qwHiy  «r  4rtcrteralai  eoMvtle  ta  f 
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Delaydlme) 

End; 

End; 


. . . . procedure  irrte output 

procedure  writeontpnt; 
var 


■ifclB  bjrte; 
becin 

k:=0; 

for  ■:=  1  to  $aMp_rows  do  bqin 
for ps  I  to  «unp  cols  do  begin 
lc=k+l, 

if  pattcrn''(pattero_connt4i| = true 
then  writc(putteni_IIle,’  ’,1) 
else  write(pattefn_fllc,’ 
end; 
end; 

writeln(pattern_file); 

writcln(taiget_file4affet); 

end; 


') 


I I procedure  sunnnariier  . . ittit  tt) 

procedure  sumniariMr(var  sunc  bsM); 
var 

ijjc  byte; 
begin 

SunesQ; 

k:=0; 

for  Bs  1  to  saBip_raws  do  begin 
for  j:  =  1  to  sanip_cols  do  begin 
Ib=Ii-I'1; 

if  patteni'(pattern_countJ(|=lrue  then  suns stun t-l; 
end; 
end; 
end; 


. . .  procedure  sample  laker . .  1 1  m  1 1 1 1  titttt  j 

procedure  $aniple_takcr; 
var 

ijMm  integer; 
begin 

randomixe; 

B  =  1  -f  random(subj_r(nrs-samp_rows); 
randomise; 

j:  3 1 4-  random($nii!i_cois-samp_cols); 
n:=^ 

for  k:=i  to  i-f  sanip_ro«vs-i  do  begin 
for  k=  j  to  j-f  $amp_col$-l  do  begin 
n:  =  n-f  1; 

samplnl:-  subj'lk^l; 
end; 
end; 
end; 
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. . tai^_scttcr  procedure . . . . 

procedure  taiget_seHen 
var 

midpoint:  byte; 
begin 
sunu-O; 

{  midpoint: =tmnc(saaip_rows*saiiip_cols/2-l- 05); 
if  (pattem"'(paltem_couat,midpoiiit]=falM) 
then  tafget:=0  else  snmmarizer(sinn); 

if  (pattern^ [pattem_couid,midpoint]= true)  and  (some criteria)  then  target:=0; 
if  (pattem''[pattem_coont,midpoint]stme)  and  (sum  >s criteria) 
then  taiget_decider;  } 
taiget_decidei; 

writclnitarget  setter  complete-_4arget=’, target); 
readin; 
end; 


. . . . procedure  rotater . . . ••••••••••) 

procedure  rotater(var  pattem_coont:integer;saniples_remainin9integer); 
var 

4i,rotation_coont:  byt^ 

Ic  integer; 

nuitrix^atioa:  boolean_array_siicl; 
max_ratations:  byte; 

begin 

{.i-5et  loop  for  max_rotations> 
if  samples_remaining<3 
then  max_ratations:=samples_remaining 
else  max_rotations:s3; 

for  rotation_coont:s  1  to  rtun_rotations  do  begin 

{—Set  pattern  to  square  inatrix} 
ic=0; 

for  ie=  1  to  samp  rows  do  begin 
for  j:=  1  to  samp  cols  do  begin 
k:  =  k4-l; 

niatrn[ij]: = pattem'(pattem_countdi] 
end; 
end; 

{—Take  the  rotation  of  the  square  matrix) 
for  i:=l  to  sanip_rows  do  begin 
k:=smiip_rows; 

for  j:=l  to  sanqt_cols  do  begin 
rotation(iJ]:=nMtrix(k4]; 
k:=k-l; 
end; 
end; 

{—Convert  rotation  to  a  new  pattern) 
writein; 

pattem_coant: = pattem_count  -f  1; 

writelniin  rotater,  Pattern  number:  ’4Mttem_connt); 

k:=0; 

for  ks  1  to  sanip_rows  do  begin 
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for  J:=l  to  saiiip_cob  do  bcgfo 
Icsk-f  1; 

paltem*  (pattciii_couiitJi]:  s  rotatfoolij]: 
if  pattern'' [pattem  count^]=tnic  thca  writc(dir(17(),elir(17d)) 
~  else  wiite(chr(178),clir(17S)); 

cod; 

wiitelii; 

ead; 

{—set  the  Tahe  of  Target} 
target: = target; 
write_oatpat; 

writeiii(’tatgct  setter  coinplete_-4atgets ’.target); 
readln; 
ead; 
ead; 


•) 

} 

*) 


{—initialize  the  coanter  'permiitatioas*  and  read  in  'max  pemmtations”} 
wTite(’Enter  nundmam  number  of  patterns  desired  (0-800):’,*  *);  (beep;) 
readln(niaxjMttem_coant); 

writeC’Eider  the  row  dimension  of  your  sample  siie(34>7,or  9]:’,’  *); 
{beep;} 

readln($aaip  rows); 
samp_cols: = saaip_rows; 

write(’Enter  miiUmom  number  of  pbek  which  most  be  'on*’); 
writer  to  set  Urget  to  l-(trae):’,’  *);  (bee|^} 
readln(criteria); 


. . 

I *•*•*«***•*•«  1 1  ,•••••••••••)  iirirer  program 

begin 

clrscr; 

assign(pattem_lile,’patteni.dat’); 

rewTite(pattem_file); 

assign(tatget_fUe,’target.dat’); 

rewrite(target_llie); 


{—setup  and  read  in  array  to  be  analyzed} 

{  readln(sobj_file_naine);} 
sul;i_file_nanie: = ’sobjectl.dat’; 
writein; 

assign!  solti_file,sobJ_lile_name); 

writeC’What  is  the  row  a^  cohnaa  dimensions  of  your  training  image?  ’); 
readln(sobj_rows,snt|J_cois); 

{  sobj_rows:=187; 

$obj_cols:=142;} 

writelnC*~reading  in  the  array  to  be  analyzed—’); 
writein; 

reset(sabj_lile); 

newlsotj); 

data_coont:sO; 

x:=W1iereX; 

y:»VVheKY; 
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for  Bsl  to  siilt|_rows  do  begin 
forJ:=l  to  saiy_cols  do  begin 
GotoXYixor); 

dato_coiinb = dato_coant -f  1; 
wTite(The  data  conat  s’,dala_coant); 
read(sabj  fUc^bj'iiJ]); 
end; 
end; 

writein(’-~dat8  has  been  read  iido  the  program—.’); 

ciosc(saly_lile); 

writein; 

{-.Determine  first  pattern  and  taiget} 
new(pattem); 
pattem_coont: = 0; 
sample_takei; 
pattem_settei; 
laiget_setter; 
write_oatpiit; 

{-.Set  op  to  rotate  the  first  pattern) 
siimmariier(smn); 

samples_remaining; = max_pattem_coant.pattem_coaat; 
if  stun  >0  then  rotater(pattem_coiint,samples_remaining); 

{-.Set  up  main  loop  to  find  and  generate  new  patterns) 
repeat 

repeat_connt:=0; 

BsWhereX; 

y:xHliereY; 

repeat 

sample_talicr; 

repeat  coonttxrcpeat  connt+l; 

Goto^nrcxj); 

writeCLoo^  in  repeat  clieck=’,repeat_caant); 
repeat_cliecker(rcpeat_check); 
until  repeat_clieck>ll; 
writein; 
pattem_setter; 
taigrt  setter; 
write_oatpiit; 
smtmaimr(smn)f 

samples_iemaininp = niax_pattem_coont-pattem_connl; 
if  $um>0  then  rotater(pattem_caunt,samples_remaining); 
writein; 

until  palteni_coant>  smaxj>attem_caont; 

{Note  the  end*^  the  program) 

writeInf’The  program  is  complete  •’); 

writelni’Number  of  samples  generated  was:’,pattem_connt); 

writein; 

writc(’  please  press  <enler>  to  return  to  the  turbo  pascal  screen.*); 

{beep;) 

readin; 

dispose(pattem); 

dispose(sol;i); 

close(pattcm_fUe); 

close(target_file); 

end. 
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APPENDIX  m.  PRCX;KAM  PATIEKNS  for  the  WVELOPMrarr  OF  TRAINING 

PATTERNS  FOR  A  9  X  9  SAMPUNG  WINDOW 


program  pattcrn  gencraloi; 
uses  dos^rtjgraph; 
const 

maxj>attcnis= 800; 
max_inpiitss81; 
max_siM4_roirs  ==  ZOO; 
max_siie4__cols = 200; 
max_siMl_rows= 9; 
niax_sizel_cols = 9; 

•yp* 

boolean_aiTa]r_sizel= array [l-max_siMl_rows,L4nax_siiel_col$]  of  boolean; 
boolean  array_$ize3= array (Ljnax_pattenis,l-max_inpats)  of  boolean; 
boolcan_array_size4= array [l-niax_size4_roirs,l-niax_size4_coIs]  of  boolean; 
boolean_col_vector=anay[Ljnaz_inpat$]  of  boolean; 

var 


criteria: 

byt^ 

data_coant: 

integer; 

ij,kAni,nAy: 

integer; 

nuujMttern_count: 

integer; 

pattern: 

''boolean_arTay_sixe3; 

pattern_coont: 

integer; 

pattern_file: 

text; 

repcat_clieclc 

byte; 

repeat_coont: 

byte; 

samp: 

boolean  col_vector; 

samp_rows,samp_coU: 

byte; 

samples  renuining: 

integer; 

sobj_file_namc: 

string; 

subj  rws^bj_cols: 

byte; 

subj: 

''boolean_array_size4; 

subj  file: 

file  of  boolean; 

sum: 

byte; 

target: 

byte; 

target_file: 

text; 

j  *••••««•  •  •  •••••«•*«•*•  procedure  beep  •*••••••••••••••••••••••••••••••) 

procedure  beep; 
var 

i:  byte; 

Frerp  integer; 

Time:  integer; 

Begin 

FrerpsZSO; 

For  i:=  1  to  3  do  begin 
Sound(Freq); 

Tinie:  =  2S0; 

DelayfUme); 

Nosound; 
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. . •••*••••••••••»  procedure  patteni_setter  •••••••••••••••••••••••} 

procedure  paMem_setter; 
var 

ij:  byte; 

Ic  integer; 
begin 

pattern  cannbspattem  count-fl; 

lc=0;  ■ 

for  bsl  to  saBip_rDurs  do  begin 
for  j:=l  to  samp  cols  do  begin 
lc=k-fl; 

pattem*[pattem_connM(]: = sanip[k]; 

if  pattern'' [pattem_coont^]= true  then  write(chr(i76),clir(176)) 
else  urritc(chr(178),clir(178)); 

end; 

writein; 

end; 

writelnCEidting  pattem_settcr_pattem_coont:  s  ’jMdtemjcount); 
end; 


procedure  repeat  checker  ••••••••••••••••••••••) 

procedure  repcat_clMcker(var  repeat_eheck:byte); 
var 

B  integer; 
jjcounten  byte; 
out  count:  integer; 
begin 

if  pattem_connts  1 
then  ont_count:  s  pattcm_connt  1 
else  onl_connt:spattcm_coont; 
i:=0; 
repeal 
Bsit-l; 
coanlen=(l; 

for  j:=  1  to  samp  ro«rs*saiap  cols  do  begin 
if  pallem*[ij|=saiBp(j|  then  counters  counter  ■*■!; 
end; 

until  (counters  sanip_rxnvs*sanip_cols)  or  (isool_caont); 
if  counters  sanip_rows*sainp_cols 

then  repcal_check:sO 
else  repeat_check:s  1; 


{••••••»«*••••••••••••••••  •••  target  decider  **e»»»e>«ieee*eeeee*ee**«*} 

procedure  targel_decidcr; 
var 

ijs  byte; 
k:  integer; 
begin 

wrile(Tinie  for  a  target  decision__Enter  the  Target  {  0  or  I]:*); 

(beep;! 

readln(targrt); 

end; 
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. . in  I  »>»»«>*»««>»»  uicct  sctter  procedure . . 

procedore  tnr(«t_Mtter; 
var 

midpoiiit:  bjdc; 


sDm:=:0; 

{  midpoiiit: =tranc(samp_rows*saiiip_cals/2-f0^; 
if  (patteni'[paMcni_coant,iiiidpoiiit]=fieise) 
then  taipcfcsO  else  saiiiniarizcr(siim); 

if  (patteni'{palteiii_caaiit,iiiidpoint]strue)  and  (snm<crfteria)  then  taigehsO; 
if  (pattern*' [paltern_coaat,iiiid|Mint]= true)  and  (snm>=  criteria) 
then  targetjiccidcr;  > 
taiget_decidei; 

writcInCHai^pet  setter  complete— dai^=’,tai^); 
readin; 
end; 


•••••••••••••••••*  procedure  rotater  MiMiiiiiiiirMiiiiitiinii} 

procedure  rotater(Tar  patteiii_count:intc8er;samples_remainin8;integer); 
var 

ij,rotation_coant:  Iqrtc; 

Ic  integer; 

matrix,rotation:  boolean_arra]r_siiel; 
max_rotations:  iqde; 

begin 

{—Set  loop  for  maz_rotations} 
if  samplcs_reniaining<3 
then  max_rotations:ssamples_reniaining 
else  niax_rotations:s3; 

for  rotalion_coaiil:s  1  to  nua_rotations  do  begin 

{—Set  pattern  to  srpure  matrix) 

k:=0; 

for  B=  1  to  samp_rows  do  begin 
for  j:=l  to  samp  cols  do  begin 
lB=k+l; 

matrix(y]:=pattcrn‘'[pattern_coontdr] 

end; 

end; 

{—Take  the  rotation  of  the  square  matrix) 
for  i:= 1  to  samp_rows  do  begin 
lB=sainp_rmrs; 

for  j:=  1  to  samp_cols  do  begin 
rotalion[id): = matrix(iM]; 
k:=k-l; 
end; 
end; 

{—Convert  rotation  to  a  new  pattern) 
writein; 

pattern_caont:wpattera_coant-t’  1; 

writcInfTn  rotater,  Pattern  mnnben  ’,pattern  count); 

k:=0; 

for  few  1  to  sanip_rows  do  begin 
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for  j:sl  to  saiii|t_cols  do  begin 
Ic3k-f  I; 

pattern'' [patteni_caanlj[]: »  rotation(iJI; 
if  pattern'' [pattem_coantJ[]=tnie  then  write(clir(176),elir(176)) 
else  iiTite(clir(178),clir(178)); 

end; 

writein; 

end; 

the  value  of  Target} 
target: = target; 
writejMitput; 

writeiii(’taiget  setter  coaipletc«_Jajget= ’garget); 
readln; 
end; 
end; 


. . . . 

I****************************  driver  program  ••••••••••••••••••••••••••} 

I************* . . 

begin 

cirscr; 

assign(pattem_lile,’pattemdat’); 

rewrite(paltem_flle); 

assign(taiget_flie,’taigetidaf); 

rewrite(taiget_flle); 

{..initialiie  the  counter  "permutations''  and  read  in  "nun  pennutations*} 
write(’Enler  nuudmum  number  of  patterns  desired  [iL800]:V  ’ll  {bee|^} 
readln(iiiaxjMttem_caont); 

writeCEnter  the  row  dimension  of  ]«or  sample  siM[3A7fOr  9]:V  ’ll 
{beep;} 

readln(samp_rows); 
samp_cols: = samp_raws; 

write(’Enier  minimum  number  of  ptMls  which  most  be  *00*0; 
writer  to  set  target  to  l=(true):V  *);  (beep;) 
rcadln(criteria); 


{—setup  and  read  in  array  to  be  amdyicd) 

(  readln(sabj_file_name);} 
sobj_f!le_iiame: = ’subject  l^lat^ 
writein; 

as$ign(  subj_lllc,siritj_filc_name); 

write(’WliM  is  the  row  a^  cohmm  dimensions  of  your  training  image?  *); 
readln(  subj_rows,snhi_cols); 

{  $ohi_rows:slS7; 

$abj_cols:w  142;} 

writeInC—- reading  in  the  arrqr  to  be  anatyicrL— .’); 
writein; 

reset(raiti_lllei; 

new(sahj); 

data_coonl:w8; 

BwWhereX; 

r.>Whct«Yi 
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for  i:=l  to  soij_nnrs  do  bcgiB 
for  j:=l  to  Mt{i_cols  do  begin 
GotoXY(xjr); 

data_co«nt:  s  dat«_coant -f  1; 
writefThe  data  count  =’,data  coont); 
i«ad(subjjllc^bj'[y]); 
end; 
end; 

writelnC— >data  has  been  read  into  the  program—.*); 

close(siiiy_flle); 

writcin; 

{—Determine  first  pattern  and  target} 
new(pattem); 
pattem_couat: = 0; 
sampiejaker; 
pattem_setter; 
larget_$ettcr; 
write_oiitpat; 

{—Set  np  to  rotate  the  first  pattern) 
sammarnerfsam); 

sainples_remaining? = mazjMttem_coant-pattem_caiiat; 
if  siim>0  then  rotater(pattcm_coant,samples_rcmaining); 

{—Set  np  main  loop  to  find  and  generate  new  patterns) 
repeat 

repeat_coant:=0; 

s^lVhcreX; 

ytsWbereY; 

repeat 

samplc_taker; 

repeat_coant:  rcpeat_caont  -f  1; 

GotoXY(Xiy); 

writeCXoops  in  repeat  check=’,repeat_caont); 
repeat_cliecker(repeat_check); 
until  rep^_clieck>lk 
writein; 
pattern^  setter; 
target_setter; 
write_outpnt; 
summarizer(sam); 

$amples_rcniainin9-maxjpattem_coant-pattem  count; 
if  sam>0  then  rotatcr(pattcrn_connt,sampics_remaining); 
wrMcIn; 

until  pattcm_caant>  3niax_pattcm_connt; 

{Note  the  end  of  the  program) 

writetni’The  program  is  complete  •*); 

writelnCNumher  of  samples  generated  wasi’^iatteni  count); 

writein; 

writeC  please  press  <enter>  to  return  to  the  turbo  pascal  screen.*); 

{beep;) 

rcadin; 

d)spose(pattem); 

dispose(subj); 

cloM(pattcm_fi)e); 

close(target_flle); 

end. 
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AHENDIXIV.  THE  ICMFIATC  FOR  THE  PARAMETERS  OF  THE  3  X  3 

SAMPLING  WINDOW  AS  IKVQOPED  BV  THE  HtOGRAM 
BINARyHAM 


Number  of  Hidden  Neuranss  59  Number  of  elements  in  emh  patterns  9 


Patterns  on  each  neuron  of  hidden  bqrer: 
111111111 
000010000 
000010011 
111111100 
001110000 
000011100 
110010000 
000110101 
001011010 
110111011 
001010100 
010011000 
101110111 
111111110 
100010001 
001111111 
000010111 
000110110 
011110111 
010110010 
1000  1  0  1  10 
001011001 
010010110 
111111110 
101010010 
001111111 
111101101 
101011101 
010110000 
111101111 
111101111 
101011111 


100011010 

011010100 

100110010 

011010001 

110110101 

111111100 

100011000 

000111001 

111110011 

101110111 

011111100 

011010010 

110010000 

100110100 

101011101 

011011111 

110111011 

100111000 

001110100 

010010101 

110011111 

101011000 

001010000 

000111010 

101101111 

111010111 

010110000 


Thresholds  (one  for  each  neuron) 

4522111112118028601101170186277107118081808180 

8081818181808 


Threshold  on  the  output  neurom 
23 
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APPENDIX  V. 


THE  TEMPLATE  POR  THE  PARAMETERS  W  THE  9X9 
SAMPLING  WINDOW  AS  KVELOPED  BY  THE  PROGRAM 
BINARYHAM 


NMbcr  of  HMdta  Mitw  M  Na 


11111111 

•  ••••#  llilRRRttlilltRRRtRlllt*****! IRRtRRttll  !••• 
l««««*lltl«««««llll««»*ll !••••••! ll«»«t««lllttORO 


••••11 !•••••• 11 !•••••• 11 !•••#• 1 

•••••••••111«^R^«^1111]*«««1111 


••••111111R*^1111111^^^^^11111^^^^^11111^^^^^1111 

ll<^lllltlt««lllll«R«^^^lll^^^«^^111^0R««»lll^tt^« 

1111^^R11111*«^^1111R^^^^111^^^^»^111^^^^^«111»«« 


11^^«^1111M^^^11111«««11111111 

•  ••••••1  !••••••! 110^««^11 !!•••• 


11111^^^^1111^^^«^11111«^^^1111 
•  Ollllll^t^llllM**^!*!!!**^*^^ 
I•ll]l•••••lll••••l•lll••••llll 
•llllll«lttlllll«^««llllllllllll 
•••••1111%^«»«1111«^^^11111«^«1 
1111111111111111111111«^1111111 


1^^^1111111«R11^R11]1111^^11111^^^««^111^^«^^1111 


••••lllllt^^^llllllllllll^^llll 

••••••••••••••••••••••••••• !!•• 

nil  111  II  till  111111111111111111 

m^Riiim^^^iiiR^^^^iim***^ 

tm«i  I  mil •••1111111 111111111 

•  •iiiiim^iiiiiiiiiiit^^^iiiii 
iiiiiiiiiiiiiiitiiii«««««iim^ 
iiiiiiiiiiiiiiiiiiii««««^iim« 

•  iim^^i««iii«^m«iiiim^«ii 
1  I  m  1  1  1  !••••!  Ill !••••! II ll^^ll 
im^«^^^iiiii««^iiiitiiiiii«ii 
1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 


l^^^Rlllll^^ttRlllll^R^^llllll^^^llllll^^^^^OmO^O 
111111111111111 t !••••• !••••••••••••••••••••••••••• 

iii^iiRiiiiiRRiiiiiR^^^iiiii^^^^iiiiiii^^iiiiim^ 

•  •11111111  ••imiiii«^Riiiiiiii^iiiiiiiiiiii»iiiii 

•••ll«^lilllll«01111111«llllllll«lll««^«llll«RR«0« 

1  ll^^lll  111  !•••••••!  ll^^^^^^im^^^^^^^l  !•••••••!  1 

ii^«^^^^«iiiitR«^»iiiim^^iiiiiiiiiim^iiiiiii^» 

•  ••••iiim^tiiiiiiiiiiiiiiiiiii9^^imi^^^iiiiott« 

iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii 


•  111111 1  !••••••• 1 !•••••••• I •••• 

•  1  ■••••I  ^{•••••^^•••••••M* 

I  !••••!  I  til l•••lllllll•••llllll 

•  •••1  1  ■••••••I  1 !••••••! I  1 1 !••! 1 

II  !•••••!  m^^^^iii  •••••!  im«^ 
IO•••••••lll••••••lltll•••••llt 

•  iniiimi]]iiiii««iiiim«»ii 


11111111111111  ••iiiiim^iiiiiii^^^iiiiii^^  •11111 

••••iiiti^^«^««^iii^^^^^^iiiiii^^^^^iiii^^^^^iiii 

•  •llll«^«*«llll««*«91111*«*^^llllll 111  111  11111  111 
••iiii««^^«iiii««««^itii«^«^^iiii]iiiiiiiiiiiiiii 

ii««^titi«««««iiii««*»iiii«^«*^iii«^^»^^ii]iii»^« 
ii«^iiitiii^«iiiiimiiiiiiiiiiiiiiiiiiiiiiiiiiii 
iiiii»«it iiiii««««ii««^«*^«ii»»^^^^»»ii^^*»^«^^ii 
iiii^«««««iii««««^«iii«*»»«*iiiii«»«»iiiii»«««iii 
11  !!••••  tiiii««^«iiiii««^^imi«^^iiii»^*»»iim* 

•••••iiii«»«^«iiiii«««miim^iiiiiimiiiiiiiii 

••••iiitiii««iiiiiitiiiiiiiiiii««^«»«iii»*»^^^^«i 

•  •until  ••  1111111  ••iiiiim^iiii^^^Riii^^^^^^iii 
iimRiiniiiiiii^R^iiiii^^^^iiiii^^v^iiim^^iii 
iiim^Rtiiiiif^^iiiim^^iiiim^^iiiii^^^^^^iii 


111111111111111111 


1519UmSZSUUttl4l5141717US9H17t9U21MN19f9l»2iai»a^UNIRS91»M14i» 
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APPENDIX  VI.  NOTATION. 

a:  Activation  value  of  a  neuron 

b:  bias.  This  value  determines  the  lateral  placement  of  the  sigmoid  transfer 

function  with  respect  to  the  axis  of  the  dependent  variable(s). 
t:  threshold  value  for  a  transfer  function 

V,  w:  connection  constants,  i.e.,  weights,  offsets,  etc. 

/:  Symbol  for  the  transfer  function  of  a  neuron 

E:  Summation 
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